Learning to Selectively Transfer: Reinforced Transfer Learning for Deep Text Matching

Deep text matching approaches have been widely studied for many applications including question answering and information retrieval systems. To deal with a domain that has insufficient labeled data, these approaches can be used in a Transfer Learning (TL) setting to leverage labeled data from a resource-rich source domain. To achieve better performance, source domain data selection is essential in this process to prevent the "negative transfer" problem. However, the emerging deep transfer models do not fit well with most existing data selection methods, because the data selection policy and the transfer learning model are not jointly trained, leading to sub-optimal training efficiency. In this paper, we propose a novel reinforced data selector to select high-quality source domain data to help the TL model. Specifically, the data selector "acts" on the source domain data to find a subset for optimization of the TL model, and the performance of the TL model can provide "rewards" in turn to update the selector. We build the reinforced data selector based on the actor-critic framework and integrate it to a DNN based transfer learning model, resulting in a Reinforced Transfer Learning (RTL) method. We perform a thorough experimental evaluation on two major tasks for text matching, namely, paraphrase identification and natural language inference. Experimental results show the proposed RTL can significantly improve the performance of the TL model. We further investigate different settings of states, rewards, and policy optimization methods to examine the robustness of our method. Last, we conduct a case study on the selected data and find our method is able to select source domain data whose Wasserstein distance is close to the target domain data. This is reasonable and intuitive as such source domain data can provide more transferability power to the model.Comment: Accepted to WSDM 201

Measurement of the cross-section of high transverse momentum vector bosons reconstructed as single jets and studies of jet substructure in pp collisions at √s = 7 TeV with the ATLAS detector

This paper presents a measurement of the cross-section for high transverse momentum W and Z bosons produced in pp collisions and decaying to all-hadronic final states. The data used in the analysis were recorded by the ATLAS detector at the CERN Large Hadron Collider at a centre-of-mass energy of √s = 7 TeV;{\rm Te}{\rm V}$and correspond to an integrated luminosity of$4.6\;{\rm f}{{{\rm b}}^{-1}}$. The measurement is performed by reconstructing the boosted W or Z bosons in single jets. The reconstructed jet mass is used to identify the W and Z bosons, and a jet substructure method based on energy cluster information in the jet centre-of-mass frame is used to suppress the large multi-jet background. The cross-section for events with a hadronically decaying W or Z boson, with transverse momentum${{p}_{{\rm T}}}\gt 320\;{\rm Ge}{\rm V}$and pseudorapidity$|\eta |\lt 1.9$, is measured to be${{\sigma }_{W+Z}}=8.5\pm 1.7$ pb and is compared to next-to-leading-order calculations. The selected events are further used to study jet grooming techniques

Search for pair-produced long-lived neutral particles decaying to jets in the ATLAS hadronic calorimeter in ppcollisions at √s=8TeV

The ATLAS detector at the Large Hadron Collider at CERN is used to search for the decay of a scalar boson to a pair of long-lived particles, neutral under the Standard Model gauge group, in 20.3fb−1of data collected in proton–proton collisions at √s=8TeV. This search is sensitive to long-lived particles that decay to Standard Model particles producing jets at the outer edge of the ATLAS electromagnetic calorimeter or inside the hadronic calorimeter. No significant excess of events is observed. Limits are reported on the product of the scalar boson production cross section times branching ratio into long-lived neutral particles as a function of the proper lifetime of the particles. Limits are reported for boson masses from 100 GeVto 900 GeV, and a long-lived neutral particle mass from 10 GeVto 150 GeV

Search for direct pair production of the top squark in all-hadronic final states in proton-proton collisions at s√=8 TeV with the ATLAS detector

The results of a search for direct pair production of the scalar partner to the top quark using an integrated luminosity of 20.1fb−1 of proton–proton collision data at √s = 8 TeV recorded with the ATLAS detector at the LHC are reported. The top squark is assumed to decay via t˜→tχ˜01 or t˜→ bχ˜±1 →bW(∗)χ˜01 , where χ˜01 (χ˜±1 ) denotes the lightest neutralino (chargino) in supersymmetric models. The search targets a fully-hadronic final state in events with four or more jets and large missing transverse momentum. No significant excess over the Standard Model background prediction is observed, and exclusion limits are reported in terms of the top squark and neutralino masses and as a function of the branching fraction of t˜ → tχ˜01 . For a branching fraction of 100%, top squark masses in the range 270–645 GeV are excluded for χ˜01 masses below 30 GeV. For a branching fraction of 50% to either t˜ → tχ˜01 or t˜ → bχ˜±1 , and assuming the χ˜±1 mass to be twice the χ˜01 mass, top squark masses in the range 250–550 GeV are excluded for χ˜01 masses below 60 GeV

Search for new phenomena in final states with an energetic jet and large missing transverse momentum in pp collisions at root s = 8 TeV with the ATLAS detector (vol 75, 299, 2015)

Results of a search for new phenomena in final states with an energetic jet and large missing transverse momentum are reported. The search uses 20.3 fb−1 of √s=8 TeV data collected in 2012 with the ATLAS detector at the LHC. Events are required to have at least one jet with pT>120 GeV and no leptons. Nine signal regions are considered with increasing missing transverse momentum requirements between EmissT>150 GeV and EmissT>700 GeV. Good agreement is observed between the number of events in data and Standard Model expectations. The results are translated into exclusion limits on models with either large extra spatial dimensions, pair production of weakly interacting dark matter candidates, or production of very light gravitinos in a gauge-mediated supersymmetric model. In addition, limits on the production of an invisibly decaying Higgs-like boson leading to similar topologies in the final state are presented

Measurement of the W±Z boson pair-production cross section in pp collisions at √s=13TeV with the ATLAS detector

published_or_final_versio

Anatomy of the sign-problem in heavy-dense QCD

QCD at finite densities of heavy quarks is investigated using the density-of-states method. The phase factor expectation value of the quark determinant is calculated to unprecedented precision as a function of the chemical potential. Results are validated using those from a reweighting approach where the latter can produce a significant signalto-noise ratio. We confirm the particle–hole symmetry at low temperatures, find a strong sign problem at intermediate values of the chemical potential, and an inverse Silver Blaze feature for chemical potentials close to the onset value: here, the phase-quenched theory underestimates the density of the full theory

Search for High-Mass Resonances Decaying to τν in pp Collisions at √s=13 TeV with the ATLAS Detector

A search for high-mass resonances decaying to τν using proton-proton collisions at √s=13 TeV produced by the Large Hadron Collider is presented. Only τ-lepton decays with hadrons in the final state are considered. The data were recorded with the ATLAS detector and correspond to an integrated luminosity of 36.1 fb−1. No statistically significant excess above the standard model expectation is observed; model-independent upper limits are set on the visible τν production cross section. Heavy W′ bosons with masses less than 3.7 TeV in the sequential standard model and masses less than 2.2–3.8 TeV depending on the coupling in the nonuniversal G(221) model are excluded at the 95% credibility level

Search for the direct production of charginos and neutralinos in final states with tau leptons in √s=13 TeV collisions with the ATLAS detector

A search for the direct production of charginos and neutralinos in final states with at least two hadronically decaying tau leptons is presented. The analysis uses a dataset of pp collisions corresponding to an integrated luminosity of 36.1 fb−1, recorded with the ATLAS detector at the Large Hadron Collider at a centre-of-mass energy of 13TeV.Nosignificant deviation from the expected Standard Model background is observed. Limits are derived in scenarios of ˜χ+1 ˜χ−1 pair production and of ˜χ±1 ˜χ02 and ˜χ+1 ˜χ−1 production in simplified models where the neutralinos and charginos decay solely via intermediate left-handed staus and tau sneutrinos, and the mass of the ˜ τL state is set to be halfway between the masses of the ˜χ±1 and the ˜χ01. Chargino masses up to 630 GeV are excluded at 95% confidence level in the scenario of direct production of ˜χ+1 ˜χ−1 for a massless ˜χ01. Common ˜χ±1 and ˜χ02 masses up to 760 GeV are excluded in the case of production of ˜χ±1 ˜χ02 and ˜χ+1 ˜χ−1 assuming a massless ˜χ01. Exclusion limits for additional benchmark scenarios with large and small mass-splitting between the ˜χ±1 and the ˜χ01 are also studied by varying the ˜ τL mass between the masses of the ˜χ±1 and the ˜χ01